Monotonic entropy growth for the Ulam's redistribution problem 
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We present a proof of the monotonic entropy growth for a nonlinear discrete-time evolution 
proposed recently as a model of transactions between economical agents. This model, based on 
binary collisions, also may be viewed as a particular case of the Ulam's redistribution of energy 
problem, when the total energy of a given pair of colliding particles is redistributed between them 
at random. We represent each step of this evolution as a combination of two processes. The first one 
is a linear energy- conserving evolution of the two-particle distribution, for which the entropy growth 
can be easily verified. The original nonlinear process is actually a result of a specific 'coarse-graining' 
of this linear evolution, when after the collision one variable is eliminated from the two-particle 
distribution function. This second process is of the same type as the real space renormalization group 
transformation and leads to an additional entropy growth. The combination of these two factors 
produce the required result which is obtained only by means of information theory inequalities. 

PACS numbers: 05.20.Dd, 89.65. Gh, 89.70.Cf 
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It is widely known that for a stochastic Markov pro- 
cess on some space of x's when the evolution of the dis- 
tribution function p{x, t) is governed by a linear mas- 
ter equation with an equilibrium (or steady) state Po(x) 
there exists a Lyapunov function which monotonically 
decreases when we approach equilibrium [l[ (see also ear- 
lier works by Schlogl Q and e.g. Q for more recent re- 
lated studies). This function is just the relative entropy 
K = ^2 x p{x, t) hip(x, t)/po(x), which also has the mean- 
ing of the 'information gain' that we obtain when the 
knowledge about the true distribution p(x,t) becomes 
available if we a priory knew only the equilibrium one 
Po(x). K may be also viewed as a total entropy produc- 
tion that takes place during the whole relaxation process 

There is no such general result for nonlinear evolu- 
tion equations, where monotonicity of possible Lyapunov 
functions should be proved independently for each prob- 
lem. There are, however, situations when it is just the 
Boltzmann entropy which monotonically grows when we 
approach equilibrium, the most know example being the 
Boltzmann equation itself where this monotonicity is es- 
tablished by the famous TJ-theorem 

Quite recently an interesting nonlinear evolution was 
proposed and analyzed as a gas-like economic model in 
a series of papers [5]. This is a discrete-time evolution 
for distributions p(x) denned on a positive half-line x 6 
[0, oo ) and on each step of iterative procedure p(x) — > 
p'(x), where 



p'(x) = 



dudv 



6(u + v — x) 



p(u)p(v) (1) 



and the ^-function ensures that u + v > x. This model 
assumes that economic transactions occur by binary 'col- 
lisions' between agents who exchange money in the same 
way as particles in a gas exchange their energy Q and 



after each collision the total amount of money they both 
possesed is distributed between them absolutely at ran- 
dom. For initial distributions with finite mean 'energy' 
(x) (which is conserved in time) this process converges to 
exponential equilibrium distribution po — aexp(— ax), 
where 1/a — (x) [5[- 

In fact, this process is an example of what is known 
as Ulam's redistribution of energy problem, stated as fol- 
lows: "Consider a vast number of particles and let us re- 
distribute the energy of these particles... First, pair the 
particles at random. Second, for each pair, redistribute 
the total energy of the pair between these particles ac- 
cording to some given fixed probability law of redistribu- 
tion..." Q- Ulam believed that the distribution of energy 
would then converge to some final distribution indepen- 
dent of the initial one and later his conjecture was indeed 
proved in Q ■ For uniform redistribution law this process 
is essentially the same as the money exchanges described 
by Eq. (|TJ) . However, the nonlinear transformation ([1]) 
first introduced in Q in economic context seems more 
suited for our study than the equation for the moments 
oip(x) used in Q- 

Since the process ((T|) conserves energy (x) and is 
very similar in spirit to the evolution that leads to the 
Boltzmann equation we expect that the entropy S(p) — 
— J dxp{x) \np(x) should monotonically increase under 
this transformation. While this conjecture, first formu- 
lated already in [5| , was indeed supported by direct com- 
putations performed there, the analytical proof of this 
growth seems to be still lacking. Note, that since en- 
tropy is obviously maximized by the equilibrium distri- 
bution po ~ exp(— ax) under the constraint (x) = const 
(see e.g. Q) it is monotonicity that has to be proved. 

Certainly, one can rewrite Eq. (p} in a form similar to 
Markov chain evolution 
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p'{x)— I duP(x,u;p)p(u), 



(2) 
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where 'transition probability' 

P(x,u;p) = I™ dv e[u + V ~ x) p(v) (3) 
7o u + v 

itself depends on Stochastic processes that may be 

related to such equations are now sometimes called non- 
linear Markov processes Q though this terminology was 
criticized in [lOj. Regardless of how we call it, if we sub- 
stitute some solution p(x) of Eq. ((T|) into P(x,u;p) we 
will end with the linear equation ^ but with time de- 
pendent transition probabilities. Close to equilibrium we 
may take P ~ P(x, u;p ) which now satisfies detailed bal- 
ance condition P(x, u;po)/~P(u, x;po) ~ exp(— ax + cm) 
and hence will definitely lead to the monotonic entropy 
growth. But far from equilibrium this approach seems to 
be of little help. 

For this reason in this note we will give a proof of 
the monotonic entropy growth for Eq. (fT]) within quite 
a different approach, which is based almost entirely on 
known information theory inequalities and utilizes the 
fact that certain coarse-graining transformations always 
result in the entropy growth. 

The main idea of the proof is (i) to introduce an aux- 
iliary linear evolution, defined on a larger space of two 
variables, for which entropy growth can be easily proved 
and then (ii) to show that ((TJ is actually a result of a 
certain coarse-graining of this linear evolution. 

For this purpose let us introduce a 'two-particle' distri- 
bution function f(x, y) which after one step of evolution 
transforms into f'(x,y), 

f(x, y) = [ d£ f(£(x + y), (1 - 0(* + V))- (4) 
Jo 

This is obviously a linear transformation and it is easy 
to see that it conserves positivity of f(x, y), its norm and 
the mean 'energy' (x + y). 

The physical meaning of Eq. Q is rather clear since 
f(x,y) describes pairs of particles. Particles, which after 
the collision have energies x and y, before the collision 
might have any energies u and v provided u+v = x+y i.e. 
we may take u = £(x + y) and v = (1 — C)(x + y), where 
< £ < 1 denotes a fraction of the total energy that the 
first particle had. Then Eq. (QJ is just the sum over all 
possibilities (all of them having equal probabilities) that 
result in the values x an y. 

It should be noted, however, that © alone does not 
describe correctly evolution of the two-particle probabil- 
ity distribution in the Ulam's problem. It takes into ac- 
count only collisions within fixed pairs of particles and 
if we choose initial distribution as a ^-function local- 
ized at some point xq, yo then after the first iteration 
it will be uniformly smeared along the isoenegretic line 
x + y = xq + yo and will not change afterwards. Though 
the expected true two-particle equilibrium distribution 

fo(x,y) = a 2 exp[-a(x + y)} (5) 

is certainly a fixed point of the transformation (QJ, this 
evolution alone cannot explain relaxation to (J5J) from 



arbitrary initial f(x,y) because this requires new ran- 
dom pairings of particles at each step, not included in 
(UJ. That is why Q has a lot of additional spurious 
'equilibriums' — any function that depends only on x + y 
does not change under this transformation. For these 
reasons only one iteration of Eq. (Q} really makes sense 
and its only purpose is to produce nonlinear equation ([1]) 
after some 'projection' procedure, described below. 

But let us first show that entropy grows for the trans- 
formation The regular way to prove such mono- 
tonicity theorems is to start from the relative entropy 
or Kullback-Leibler (KL) distance D(u\\v) = ^plnp./i/ 
between two probability distributions u and v. It is 
well known from information theory that D{^u\\v) cannot 
increase under 'coarse-graining' of these distributions, 
when some variables are integrated out. This immedi- 
ately follows from the chain rule for relative entropy fill ] 
and some examples of how this works may be found e.g. 
in [l2], [H| . Consider now the distribution 

M«, x, y) = f(£(x + y), (1 - £)(x + y)), (6) 

defined on the space £ £ [0, 1], x,y £ [0, 00) and define 
j/(£, x, y) in the same way through the equilibrium distri- 
bution fo(x,y) from ([5]). It is easy to check that both fi 
and v are positive and normalized to unity. Then define 
the coarse-graining procedure /i — >• p, as averaging over 
the £ variable, i.e. 

fj,(x,y)= d£n(£,x,y) = f'(x,y), (7) 
Jo 

according to Eq. and, obviously, v(x,y) = fo(x,y). 

The above statement about the monotonic behavior of 
KL distance can be written as 

f \ r d xdy^,x,y)\n^y\> 
Jo Jo v(£,x,y) 

> ( dxdy p(x,y) In ^. X,V (8) 
Jo v(x,y) 

In the integral on the left-hand side we now make a 
change of variables 

u = £(x + y), v = (l-£)(x + y), z = x~y (9) 

with the obvious property x + y = u + v. Then the 
integration measure and ranges of integration transform 
as follows 

pi poo poo p(u+v) 1 

dl; dxdy = - I dudv / dz (10) 

Jo Jo 2 Jo J -(u+v) u + v 

and since according to © the integrand does not de- 
pend on 2, integration over z exactly cancels the Jacobian 
l/2(u + v). 

Then, using also exact expressions for jl, Eq. ([7]), and 
i>, we can rewrite Eq. (jHJ as 

f dudv f(u, v) In ^— ' — \ > 
Jo fo(u,v) 

f°° f'(x u) 

> / dxdyf(x,y)\n^-^- (11) 
Jo fo{x,y) 
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Thus the relative entropy could not increase under the 
transformation Certainly the same inequality will be 
valid if we substitute any normalized fixed point solution 
of ^ instead of the exponential distribution fo(x, y), but 
choosing fo is more suitable for what follows. 

The same way of reasoning may be applied actu- 
ally for any linear Markov evolution of the form @ 
with P(a:, it) independent of p(x). One should take 
= V{x,u)p{u), v(x,u) = P(x,u)po(u), where 
Po(u) is an equilibrium distribution, and then integrate 
them over u to obtain fi = p'{x) and v — po{x). 
Then from equation similar to Eq. © it follows that 
K = J dxp(x)hip(x) Ipq(x) monotonically decreases on 
each iteration, which is, of course, well known. The main 
idea behind this proof is that any such evolution may 
be viewed as some kind of coarse-grai ning since it in- 
cludes integration over initial data (cf. [lj]). Note that 
for nonlinear evolution, when P(x,u;p) depends on the 
distribution function p(u), as in ([2]), and hence changes 
on each step, this approach does not work, because now 
Po is not an instantaneous equilibrium and v ^ po {x) . 

Now, since we have chosen the equilibrium distribu- 
tion in the exponential form, fo ~ exp[— a(x + y)], Eq. 
(TTT1) may be rewritten, as usual, as F > F', where 
F = (x + y) — S/a is the free energy and the entropy 
is given by S(f) = - J dxdyf(x,y)\n f(x,y). But our 
linear transformation conserves the mean energy (x + y) , 
hence the monotonicity of the free energy results in the 
entropy growth 



S' > 5. 



(12) 



Thus we have proved the monotonic entropy growth for 
our auxiliary linear transformation (j4]) . This is an almost 
evident result and it is only the first step of the proof for 
the original nonlinear problem. 

Now we need to relate the linear process ((4]) to the 
initial nonlinear evolution (TTJ. For this purpose consider 
in Eq. (j4]) a special factorized initial condition 



f(x,y) =p(x)p(y) 



(13) 



and define the transformed probability p'(x) as the 
marginal probability for the transformed distribution, i.e. 



p'{x) = / dyf'(x,y). 



(14) 



Since f'{x, y) is symmetric under the permutation of vari- 
ables x and y it actually does not matter which one vari- 
able to integrate out. 
Then we have 

/"OO [>1 

p'{x)= dy dip{i{x + y))p{{l-0{x + y)) = 
Jo Jo 

1,00 °{u + v~x) 



/ du 
Jo Jo 



dv ■ 



u + v 



-p{u)p{v), (15) 



where we have made the change of variables (£, y) — > 
(it, v) similar to ©, u = £(x + y), v = (1 — £)(x + y), 



with the Jacobian l/(u + v). The condition u + v > x 
arises from the positivity of y = u + v — x. Clearly this 
is exactly the required nonlinear Eq. (TTJ). 

Thus, on each step the nonlinear evolution of the gas- 
like model may be obtained by a kind of 'projection' pro- 
cedure from the linear transformation Q by choosing 
the special initial conditions (|13p and by the subsequent 
elimination of one variable from the resulting two-particle 
distribution function ((T4)) . 

Another way to look at this phenomenon is to say that 
our non-linear evolution may be represented as a combi- 
nation of two processes. The first one is the linear evolu- 
tion of Eq. (|4]) with initial condition (TT3l) which should 
be supplemented then by the subsequent 'reduction' of 
/'(x,y) back to the factorized form, which corresponds 
to a new random pairing of particles and is, in its turn, 
the new initial condition for the next step. 

But elimination of exactly half of the variables, as in 
Eq. (fT4"|) . is also related to some monotonicity property. 
For example, for the real space decimation renormaliza- 
tion transformation in spin systems, when on each step 
of renormalization we divide the lattice into two identical 
sublattices and half of all spins are summed away [l5j . 
the en trop y per lattice site was shown to grow monoton- 
ically [13| . For the sake of completeness we repeat here 
this simple derivation as applied to our present system. 

This monotonicity of entropy per degree of freedom 
results just from the positivity of the mutual information 
of two sets of variables. In our present case the mutual 
information of x and y variables after the transformation 
whose joint probability distribution is f'{x,y) and 
marginal distributions are p'(x) and p'(y), is given by 
the usual formula (ill 



dxdy f'{x,y)\n 



f'(x,y) 
p'(x)p'{y) 



> 0. 



(16) 



This mutual information may be written also as a differ- 
ence between the sum of entropies of subsystems (which 
are identical in our case) and the total entropy of the 
joint distribution 



/ = 2S( P ') - S(f), 



(17) 



where S(p') = — J dxp'(x) \np'(x) and S(f') is the en 
tropy of the two particle system which earlier in Eq. ([12] 
was denoted by S' . 

Hence from / > it follows 



s(p') > \s'. 



(18) 



Note that this inequality is not just a trivial consequence 
of the information loss or decrease of the relative entropy 
after one variable is eliminated. Information loss results 
in the decrease of the total entropy, which looks like S' > 
S(p') and is clearly distinct from Eq. (fTS]). 

Now we can combine this inequality with the one ob- 
tained earlier for the linear evolution, Eq. (TT2"j) . to arrive 
at S(p') > 5/2. But for the factorized initial distribution 
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Eq. (p~3|) the entropy S is just twice the one-particle en- 
tropy of the distribution p(x), i.e. S = 2S(p) and hence 
we finally have 

S( P ') > S( P ). (19) 

This completes the proof that the entropy S(p) = 
— J dxp(x) \np(x) monotonically grows on each step un- 
der iterations of the nonlinear transformation (flj . 

Let us now give some example illustrating our general 
proof. If we start from the distribution p(x) — xexp(-x) 
with entropy S(p) = 7 + 1 ~ 1.5772 (7 ~ 0.5772 is the 
Euler constant), then for the factorized initial condition 
(TT3]) we will have f'(x,y) — l/6(x + y)exp[—(x + y)} 
from Eq. ((4]). The corresponding entropy per degree 
of freedom is now larger, S'/2 = 7 + 1/6 + l/21n(6) ~ 
1.6397 > S(p). After we eliminate one variable we will 
finally have p'(x) — 1/6 (x 2 + 2x + 2) exp(— x), which is 
the correct expression that one may get directly from 
the transformation fT]) and the entropy now equals 
S(p') ~ 1.6667 which in its turn is slightly larger than 
S' /2. Thus we see how entropy indeed grows on each 
stage of our combined evolution that is equivalent to the 
initial nonlinear transformation. 

In summary, we have proved the monotonic entropy 
growth for a nonlinear evolution which describes pairwise 
interaction of economical agents with random money ex- 



changes and also may be viewed as a particular case of 
the Ulam's redistribution of energy problem. The proof 
is based on representing a single step of the nonlinear 
evolution for as a combination of two steps: the first is 
related to an auxiliary linear two-particle process and the 
second one is a kind of a coarse-graining, similar to deci- 
mation rcnormalization transformation, when one of the 
two variables is integrated away. Since on both steps the 
entropy can be shown to increase we conclude that the 
entropy is indeed monotonically increasing for the origi- 
nal nonlinear problem. 

The proof is based entirely on information theory in- 
equalities and possibly may be of some use for other non- 
linear problems. We do not exclude, however, that some 
more simple and direct proof may exist for the given 
problem. Note also that the proof we present here is 
valid only for the uniform redistribution law when after 
a 'collision' a given agent may have any amount of money 
from the admissible interval with equal probability. 
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